Web Survey Bibliography
During the past 15 years, in an effort to improve survey data quality, survey practitioners have significantly increased their use of an evolving set of questionnaire pretesting methods. Several researchers have addressed issues related to questionnaire evaluation, and have attempted to determine the potential strengths and weaknesses of each (Campanelli, 1997; DeMaio, Mathiowetz, Rothgeb, Beach, and Durant,1993; Oksenberg Cannell, and Kalton, 1991; Presser and Blair,1994; Willis, 2001). Further, several empirical investigations have evaluated the effectiveness of core features of these techniques, especially the use of verbal probing within cognitive interviewing (Davis and DeMaio 1992; Foddy, 1996) and several evaluative studies have attempted to assess the effectiveness of cognitive interviews in ameliorating questionnaire problems (Fowler and Cosenza, 2000; Lessler, Tourangeau, and Salter, 1989; Presser and Blair; Willis and Schechter, 1996; Willis, Schechter, and Whitaker, 1999); these are reviewed in detail by Willis (2001). Increasingly, evaluations have focused on the side-by-side comparison of survey pretesting techniques, in order to determine the degree to which the results obtained through use of these techniques agree, even if they cannot be directly validated. However, this research is complex, as evaluation in practice must take into account the multi-faceted nature of each of the pretesting techniques, and of questionnaire design in general (see Willis, DeMaio, and Harris-Kojetin, 1999). Although two studies (Presser and Blair, 1994; Willis, 2001) have specifically compared the results of cognitive interviewing, expert evaluation, and behavior coding, when these have been applied to the same questionnaire, this research has generally not been conducted in a way that allows for the separation of the effects of pretesting method from those of the organization applying these methods. The overall objective of this study was to rectify this limitation. Overall the selected design balanced technique with organization, for the same set of questionnaires (see Lessler and Rothgeb, 1999; Rothgeb and Willis, 1999), to determine level of agreement among three pretesting techniques, when applied by each of three survey research organizations. For this research, multiple researchers within each of the organizations used three pretesting methods: Informal expert review, Formal cognitive appraisal, and Cognitive Interviewing. A classification scheme was developed to code problems identified through any of the methods, and by each organization.
Homepage (abstract) / (full text)
Web survey bibliography - Conference proceedings (83)
- The Influence of Human Cues on Drop-out and Answer Behaviour within Web Surveys; 2008; Oesterlau, T., Geißler, H.
- Sampling for web surveys; 2007; Rivers, D.
- Reconstructing childhood health histories using internet panels; 2007; Smith, J. P.
- Pilot study to recruite a sample for an online panel: Effects of contact mode, incentives and information...; 2007; Scherpenzeel, A.
- Modes, trends, and content: A comparison of the 2003 HRS internet survey with HRS 2002 and 2004 Core...; 2007; Weir, D.
- Lessons learned: Converting a telephone survey panel to an internet panel; 2007; Roe, D. J., Stockdale, J., Farrelly, M., Heinrich, T.
- Developments in electronic survey design for establishment surveys; 2007; O'Neill, G.
- Response time measurement in the lab and on the Web: A comparison; 2007; Galesic, M., Reips, U.-D., Kaczmirek, L., Czienskowski, U., Liske, N., von Oertzen, T.
- Questionnaire and Survey Design for Online Research; 2007; Wydra, D., Fisher, L., Strunk, K.
- Using Technology to Improve Data Quality; 2007; Cunningham, J., Pearson, C., Parkhurst, D.
- Mobile Phone Data Collection; 2007; Lavine, S.
- Effects of Offering Web Questionnaires as an Option in Enterprise Surveys: the Swedish Experience; 2007; Erikson, J., Furubjelke, E.
- Using the Web for Surveys of Medical Providers; 2007; Narayanan, V., Giambo, P., Fry, S., Crafts, J.
- Boosting Response Rates: Are There Optimal Times to Email Respondents?; 2007; Bennett-Harper, S., O'Brien, J., Levin, K., Davis, B., Shipp, S., Campbell, S., Sienkiewicz, R.
- Beyond Demographics: Are ‘Webographic’ Questions Useful for Reducing the Selection Bias...; 2007; Schonlau, M., van Soest, A., Kapteyn, A.
- Maximising respondent engagement: The use of rich media; 2007; Reid, J., Morden, M., Perez Echeverria, A.
- Truth in measurement: Comparing Web Based interviewing Techniques; 2007; Couper, M. P., Terhanian, G., Bremer, J., Thomas, R. K.
- The power of the visible: Visual design for Web surveys; 2006; Couper, M. P.
- Attitudinal differences. Comparing people who belong to multiple versus single panels; 2006; Casdas, D., Fine, B., Menictas, C.
- Weighting an Internet Panel Survey on Drug Use and Abuse; 2006; Gordek, H., Williams, Ri. L., Dai, L.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Electronic Voting Machines – A comparison applying the principles of computer-human interaction...; 2003; Callegaro, M., Peytcheva, E.
- More than a thousand words? Visual cues and visual knowledge; 2002; Prior, M.
- Questionnaire Pretesting Methods: Do Different Techniques and Different Organizations Produce Similar...; 2001; Rothgeb, J. M., Willis, G. B., Forsyth, B. H.
- Practical methods for sampling rare and mobile populations; 2001; Kalton, G.
- Building an alternative response process model for business surveys; 2001; Willimack, D. K., Nichols, E. M.
- Human centered measures of success in web site design; 1998; Kirakowski, J., Claridge, N., Whitehand, R.
- The Prodigy Experiment in Using e-Mail for Tracking Public Opinion; 1995; Werner, J., Maisel, R., Robinson, K.
- Respondent preferences toward audio-CASI and how that affects data quality; 1995; Kinsey, S. H., Thornberry, J. S., Carson, C. P., Duffer, A. P.
- Best pracices in disk-by-mail surveys; 1992; Witt, K. J., Bernstein, S.
- Customer satisfaction research using disks-by-mail; 1989; Zabdan, P., Frost, L.